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The Lyapounov exponent and sharp conditions for geometric er- 
godicity are determined of a time series model with both a thresh¬ 
old autoregression term and threshold autoregressive conditional het- 
eroscedastic (ARCH) errors. The conditions require studying or simu¬ 
lating the behavior of a bounded, ergodic Markov chain. The method 
of proof is based on a new approach, called the piggyback method, that 
exploits the relationship between the time series and the bounded 
chain. 

The piggyback method also provides a means for evaluating the 
Lyapounov exponent by simulation and provides a new perspective 
on moments, illuminating recent results for the distribution tails of 
GARCH models. 

1. Introduction. Modeling the stochastic volatility of econometric and 
other time series with autoregressive conditional heteroscedastic (ARCH 
and GARCH) type models has proved to be very successful. This effort re¬ 
cently has been extended to include additional nonlinearity such as threshold 
(G)ARCH models introduced by Glosten, Jagannathan and Runkle (1993), 
Rabemanajara and Zakoian (1993) and Zakoian (1994), as well as the ad¬ 
dition of autoregression components, which may also be nonlinear [Li and 
Li (1996), Liu, Li and Li (1997), Lu (1998), Hwang and Woo (2001), Lu 
and Jiang (2001) and Lanne and Saikkonen (2004)]. For nonlinear models 
in particular, it is quite usual to make very strong assumptions about the 
parameters and/or nonlinearity in order to ensure existence of a stationary 
model. To avoid such strong assumptions, this paper introduces an approach 
that will give definitive results about stationarity and can offer insight to 
the moments of the stationary distribution. The method is applied here to 
threshold extensions of ARCH models with an autoregressive component. 
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The threshold autoregressive ARCH (TAR-ARCH) model can be ex¬ 
pressed as 


(l-l) Ct — 1) • • • 5 Ct—p) + • • •) ^t—p)sti 


where a and b are finitely piecewise continuous functions and {et} is an i.i.d. 
error sequence. The state vector for the time series is Xt = (^t,... 

The nonlinear autoregression function o(x) is continuous on individual, con¬ 
nected subregions of the boundaries of these regions are called thresh¬ 
olds, hence the nomenclature for the model. Frequently, a{x) is assumed 
to be linear on each of these regions. Likewise, this model has a state de¬ 
pendent conditional variance, 6^(x) = Yai{^t\Xt-i = x) if var(et) = 1, which 
typically is of the order of magnitude of ||a;|p. This provides the conditional 
heteroscedasticity (ARCH) behavior and for our purposes it is also assumed 
to have thresholds. 

Since the time series (1.1) is embedded into {Xt}, which is a Markov chain, 
it will have a stationary distribution when the Markov chain is ergodic. If 
a and b are sufficiently smooth (e.g., Lipschitz continuous) this may be 
verified using dynamical systems arguments [Chan and Tong (1985), Letac 
(1986), Tong (1990) and Diaconis and Freedman (1999)]. Here, however, the 
discontinuities of a and b, as well as their nonlinearity, complicate every as¬ 
pect of the argument. Another approach, which works well for nonthreshold 
ARCH models, involves reexpressing the model as a random coefficients or 
stochastic difference equation model [Brandt (1986), Engle and Bollerslev 
(1986), Bougerol (1987), Bougerol and Picard (1992a, b) and many others]. 
This approach can even provide stationary representations and tail behav¬ 
iors of the stationary distributions [Basrak, Davis and Mikosch (2002)], but 
it will not work here since the “random coefficients” would not be indepen¬ 
dent of the past values of the process. Indeed the approach assumes that 
the random coefficients are already known to be a stationary process. Our 
approach will overcome these obstacles. 

Both the dynamical systems approach and the random coefficients ap¬ 
proach are intricately tied to the concept of a Lyapounov exponent. This is 
a notion readily apparent in such systems but largely bypassed in the gen¬ 
eral literature on ergodicity of Markov processes and the like. An appropriate 
definition for the Lyapounov exponent in our context is 


liminflimsup—E^log 

llxll^oo n V 



This constant measures the “geometric drift” of the process when it is large 
(and less subject to local perturbations). If this constant is negative, then the 
process is stable in the sense that a drift condition for ergodicity is readily 
identifiable [cf. Meyn and Tweedie (1993), Theorem 15.3.7]. Our approach 
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in this effort will both identify the Lyapounov exponent and show that it is 
the critical value for determining stability. 

As is standard, we assume the following on the error term, ensuring {Xt} 
is an aperiodic, Lebesgue-irreducible T-chain on [cf. Meyn and Tweedie 
(1993) and Cline and Pu (1998)]. 

Assumption A.l. The distribution of et has Lebesgue density / which 
is locally bounded away from 0. Also, b is positive, locally bounded and 
locally bounded away from 0. 

We also have the following moment assumption. 

Assumption A.2. sup„(l -l- |u|)/(u) < oo and E{\ei\'^°) < oo for some 
ro > 0. 


In this paper we will employ further constraints on the functions a and 
b. These conform, however, to all standard uses of threshold autoregression 
and ARCH models. The first such condition is next. Except when indicated 
otherwise, || • || is the Euclidean norm though this is not strictly necessary. 

Assumption A.3. a(x)/(l-I-||x||) and 6(x)/(l + ||x||) are bounded. 


The model thus has the functional coefficient AR-ARCH (FCAR-ARCH) 
representation 


( 1 . 2 ) 


p 

— Q'o(A^i— i) T ^ 0‘j{Xt—i)^t—i 
i=l 


P 


1/2 


2 = 1 


where oq, ..., Op, bo,... ,bp are bounded functions on [e.g., ao{x) = | 

and ai{x) = | , i = I, ■ ■ ■ ,p]. Although the FCAR-ARCH repre¬ 

sentation is not unique, it seems to be a good starting point for (nonparametric) 
modeling. Stability conditions based on such a representation may not be 
sharp, however, and this is one motivation for the present work. 

Standard threshold models consider a to be piecewise linear and 6^ to be 
piecewise quadratic. More generally, it is not unreasonable to assume that 
a{x) and b{x) are asymptotically homogeneous. We state this assumption 
next. Let 0 = {0 G : ||0|| = 1}. 
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Assumption A.4. There exist x* G and bounded functions a* and 
6* on 0 such that 


.. a{x* + w6) 

lim sup- 

W^QOq^q U) 


a*(0) 


= 0 


and 


b(x» + w6) 
lim sup- 


K{e) 


= 0 . 


This actually implies Assumption A.3, but it is convenient to state both. 
It follows easily from Assumption A.4 that a and h may be decomposed as 
a{x) = ao{x) + a*(x — x*) and b{x) = bo{x) + b*{x — x*), x = (xi,..., Xp) € 
RP, where a* and b* are homogeneous [in fact, a*(x) = a*(x/||x||)||x|| and 
b*(x) = 6*(x/||x||)||x||] and oq and bg are locally bounded functions such that 
ao(x) = o(||x||) and bo(x) = o(||x||) as ||x|| —> oo. For simplicity, we henceforth 
assume x* = 0. 

By removing the nonhomogeneous terms from the model, we dehne a 
homogeneous version of the time series, 

(1-3) a = a*(X:_,) + b*(X;_,)et, 

where X; = ..., We intend to show that, under simple condi¬ 

tions, the stability of {X^} is related to that of {X^}. Furthermore, letting 
6* = X* /||Xj*||, we can describe the stability conditions in terms of the col¬ 
lapsed process {9^}. Note that {X^} is a Markov chain on Mq = \ {0} 

and, due to the homogeneity of a* and b*, {9*} is a Markov chain on 

0 = { 0 :|| 0|1 = 1 }. 

When p = 1, the latter chain obviously is a two-state chain and we examine 
this special case explicitly in Example 4.1. Much more interesting is the case 
p> 1. 

Even though we are assuming b to be locally bounded away from 0, b* need 
not be. For example, for the standard ARCH model b*{x) = (6ixf -|- • • • -b 
6pXp)^/^, where some bi may be 0. This requires an additional assumption 
and some care. We dehne Bq to be the set on which liminf^^a. b*{y) = 0 and 
Hq = {x: miuj \xi \ = 0}. 


Assumption A.5. Ifp> 1, max(|a*(x)|,6*(x)) is locally bounded away 
from 0 on Mq and b* is locally bounded away from 0 on RJ=K»\ Hq (hence 


BoCHo). 


Our hnal assumption refers to the threshold-like nature of the model, that 
is, the piecewise continuity of a* and b*. 

Assumption A.6. If p > 1, there exist (p — 1)-dimensional homogeneous 
hyperplanes Hi,... ,Hm such that a* and b* are continuous off U^i ^j- 
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Assumption A.6 implies that the character of the model depends on the 
signs of linear combinations of the components of Xf. This is similar to and 
includes the delay assumption most authors employ. 

Define z{x,u) = a*(x) + b*(x)u for x e and u G M, and w(x,u) = 
\\{z{x,u),xi,... ,Xp-i)\\. Then^; = z(A;_i,ei) and 6^ = iz{et_^,et),9t-i^i,... ,0 
Henceforth, let //p be Lebesgue measure on and let /i© be the surface 
area measure on 0. That is, fis{A) = p/rp({x: x/||x|| G A, ||x|| < 1}). 

Section 2 discusses a direct approach to verifying stability that has its 
roots in the literature for both parametric and nonparametric models. We 
present it because of its simplicity and to contrast it with our results in 
Section 3. The main results, which are in Section 3, provide a sharp condition 
for stability and identify the Lyapounov exponent for {W}. The approach 
is based on a method of proof we have named the piggyback method. Section 
4 examines four cases explicitly. The final section contains the proofs. 


* 


)/w{ei_^ 


et). 


2. A simple sufficient condition for FCAR-ARCH models. In the spirit 
of numerous other authors, we present a simple condition for geometric er- 
godicity applicable to general functional coefficient models. This condition 
is based on bounding the FCAR-ARCH representation and therefore is sim¬ 
ple to apply, but it ultimately proves to be too rudimentary to establish 
the parameter space definitively for more specific models. The approach has 
roots in conditions for FCAR models, starting with Chan and Tong (1986), 
and culminating recently in conditions for models with both a nonlinear au¬ 
toregression and an ARCH or bilinear component [Lu (1998), Lu and Jiang 
(2001) and Ferrante, Fonseca and Vidoni (2003)]. Our theorem and corollary 
below encompass these latest results. 

First, however, we briefly recall the Foster-Lyapounov drift condition for 
establishing geometric ergodicity of a Markov chain as developed by Meyn 
and Tweedie [(1993), Theorem. 16.0.1], namely the chain is aperiodic, cj)- 
irreducible, T-continuous and there exist K < oo, Pq <1 and a test function 
V{x) > 1 such that H(x) ^ oo as ||x|| —> oo and 

E{V{Xi)\Xo = x)<K + PoV{x) for all X. 

This condition in fact establishes that {X^} is H-uniformly ergodic: with F 
as the stationary distribution and Pi G {Po, 1), 

(2.1) sup|P(A„gA|Ao = x)-F(A)| <M/3]^H(x) alln,x, 

A 

for some finite M. The further advantage of knowing something about the 
function V is twofold. First, / V{x)T{dx) < oo [cf. Meyn and Tweedie (1993), 
Theorem 14.0.1], implying that if \g{x)\ < V{x), then / |g'(x)|F((ix) < oo and 
f ff(x)r(dx) almost surely. Second, a central limit theorem 
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holds for Ya=i 9i^t) if \9ix)\ < [cf. Meyn and Tweedie (1993), The¬ 

orem 17.0.1]. In particular, an appropriate test function will ensure the ex¬ 
istence of moments. 

Theorem 2.1. Assume Assumptions A.1-A.3. If there exist nonnega¬ 
tive Ci with Ci < 1, r > 0 and K < oo such that 

( 2 . 2 ) E{\^if\Xo = x)<K + ^c^\xif, 

i=l 

for all X = (xi,..., Xp) £ then {Xt} is V-uniformly ergodic with V(x) = 
^ + Y^\=idi\xiY for some positive di,...,dp. Furthermore, the stationary 
distribution has finite rth moment. 

The theorem can be applied when one is given a specific representation 
of the model. The following corollary does so, extending Lu (1998) and Lu 
and Jiang (2001), who handle the cases r = 2 and r = 1, respectively. 

Corollary 2.2. Assume Assumptions A.1-A.3 and that there are non¬ 
negative constants oq, ..., Op, bo,... ,bp such that 

|a(x)| < ao-I-ai|xi| H-l-ap|xp| and b{x) < {b^ + b^xl-\ - \-bpXp)^^‘^. 

Each of the following implies (2.2) holds with Q < I-' 

(i) r < 1 and + KE{\etf)) < 1. 

(ii) Either 1 <r <2 and the error distribution is symmetric about 0, or 
r = 2 and E{ei) = 0, and (ELi o-iY + YFi=i Y.E{\etf) < 1. 

Although no particular FCAR-ARCH representation is assumed, it seems 
one cannot be avoided in checking the condition. Its advantage is in its 
simplicity. The conditions presented in the next section, on the other hand, 
are sharp. 

3. The piggyback method and the main resnlts. The piggyback method 
is the name we have given to a new approach for determining stability of 
nonlinear time series. This approach has proven useful for some rather simple 
models that do not behave the same as their deterministic “skeleton.” See 
Example 3.2 of Cline and Pu (1999) and Example 4.2 of Cline and Pu 
(2002). See also Gourieroux and Monfort (1992) for a simple example. We 
anticipate that this approach will prove to have its greatest use for models 
such as those studied here, namely for models in which the error terms are 
state dependent and thereby have a profound effect on stability. The name 
“piggyback” derives from the use of a Foster-Lyapounov drift condition that 
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piggybacks on the stability of another Markov process. This second process 
is related to a process embedded in the first, is more basic and has a much 
more obvious criterion for stability. 

For the threshold AR-ARCH model we are investigating, the related pro¬ 
cess is {6^} (the collapsed process) which, being a process on compact 0, 
is clearly bounded. With minimal conditions for irreducibility and so on, 
therefore, it is uniformly ergodic. We note that u;(0o,ei) (see Section 1) is 
a surrogate for the one-step change in magnitude of the AR-ARCH model, 
namely ||Xi||/||Ao|| when ||Xo|| is large. Intuitively then, the Markov chain 
{Xt} should be stable if the expected value of log(r(;(0Q, ei)), taken relative 
to the stationary distribution of {0^ }, is less than 0. The trick is to construct 
a function to verify this, especially in view of the discontinuous coefficient 
functions, and this is where the piggyback method is both extremely helpful 
and somewhat intricate. 

We now state the stability theorems for these two processes. An outline 
of the method follows the statement of Theorem 3.3. 

Theorem 3.1. Assume Assumptions A.1-A.5. Then {6^} is a -irreducible, 
uniformly ergodic T-chain on 0 with stationary distribution H satisfying 

(3.1) / / \z{9,u)\^ f{u) dul[{d6) < oo for all s € {—l,rQ]. 

Je Jr 

Moreover, define 

(3.2) /? = exp^y J log{w{9,u))f{u)duIl{d9)^. 

Then for any e > 0, there exists a bounded funetion z/: 0 —> M, sueh that 

(3.3) sup|£'(i/(0j[‘) - i^{9) -|-logrc(0,ei)|0o = ^) “ logpl < 

6»ee 

Under the stationary distribution H, z(9Q,ei)/w{9Q,ei) = 9 q i, and there¬ 
fore log/9 is also equal to jQj^log{\z{9,u)\/\9i\)f{u)duIl{d9). 

Theorem 3.2. Assume Assumptions A.1-A.6 and let p he as in (3.2). If 
p <1, then for any pi E {p, 1) there exist K < oo, s > 0 and U: ^ [1, oo) 

sueh that 


E{V{Xi)\Xq = x)<K +pIV{x) for all x eMP, 

and the test function has the form V{x) = 1-I-A(x) ||x||^, where A is bounded 
and bounded away from 0. As a consequence, {Xt} is V-uniformly ergodic. 
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Although p < \ also implies the homogeneous process {X^ } does not ex¬ 
plode, it actually is transient in this case, diminishing to 0. 

The value log p turns out to be the Lyapounov exponent for the original 
chain. This means the condition in Theorem 3.2 is sharp: {Xt} is transient 
if p > 1 by (3.4) below and Cline and Pu [(2001), Theorems 2.1 and 2.2]. 


Theorem 3.3. Assume Assumptions A.1-A.6 and let p he as in (3.2). 
Then logp is the Lyapounov exponent for {Xt}. Indeed, 


(3.4) 


lim limsup 



n 





logp 


= 0 . 


The key to the piggyback method is the use of the near-equilibrium equa¬ 
tion (3.3) in the proof of Theorem 3.2. We present here an outline of the 
method as it is applied to the TAR-ARCH model. This can be used as a 
guide to the series of lemmas that constitute the proof. 


Step 1. The preliminary step (Lemmas 5.1 and 5.2) is to show that the 
Markov chains {©j} and {Xt} are aperiodic, ^-irreducible and sufficiently 
smooth (T-chains), at least when restricted appropriately. 

Step 2. The collapsed process {6*} stays well within 0^ = Q\Hq, that 
is, away from the axial planes, with high probability (Lemma 5.3). 

Step 3. The collapsed process is uniformly ergodic and p is well defined 
(proof of Theorem 3.1). 

Step 4. Let be the smallest set closed under the map F6 = {02, ■ ■ ■ ,9p, 
and containing the thresholds and axial planes. The collapsed process stays 
well within = 0 \ with high probability (Lemma 5.4). 

Step 5. Continuity of a function q{9) on 0## ensures continuity of con¬ 
ditional expectations E{q{0’l)\9Q = 9) on 0^# (Lemma 5.5). This is required 
in order to construct a test function that can be piggybacked. 


Step 6. The near-equilibrium equation (3.3) holds with a function v{9) 
that is continuous on 0## (Lemma 5.6). 

^ Ste^ 7. Let Xf = {z{Xt-i,et),Xt-ip,... ,Xt-i^p-i). Both W/||-^t|| and 
X*/||A'*|| are well within 0#,^ and close to each other with high proba¬ 
bility, if t and ||Aio|| are large enough (Lemmas 5.7 and 5.8). Note that 
Xf /IIA”* II is what the first step of the collapsed process would be, if started 
at W_i/||W_i||. 
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Step 8. If, for some function Vi{x) and some n > 1, log(Vi(X„+i)/Vi(X„)) 
has negative expectation when conditioned on Xq = x, uniformly for large 
llxll, then a test function can be constructed to verify I/-uniform ergodicity 
of {Xt} (Lemmas 5.9 and 5.10). 

Step 9. The continuity of v{6) on the near-equilibrium equation 

and the results of Step 7 make it possible to satisfy the condition in Step 8, 
thus creating a test function for Xt by piggybacking on the simpler properties 
of the collapsed process (proof of Theorem 3.2). 

Step 10. The Lyapounov exponent for {Xt} is logp (proof of Theo¬ 
rem 3.3). 

Step 11. If an appropriate condition on the collapsed process holds, 
then the above can be applied to a test function roughly proportional to 
||x||'', thus ensuring the stationary distribution of {Xt} exists and has rth 
moment (proof of Theorem 3.5 below). 

The method just outlined is necessary because of the discontinuities in 
a* and b*. One may think that a test function that gives the required drift 
condition when applied to the homogeneous process {X^} could just as well 
be applied to the original process {Xt}. Unfortunately this is not the case 
because the expected difference between V{Xi)/V{Xq) and V{XI)/V {Xq) 
need not diminish sufficiently fast as Xq increases in magnitude. Neverthe¬ 
less, as indicated in (3.5) and (3.6) below, solving the simpler problem does 
suffice to verify stability. This is in fact the primary motivation behind our 
method. 

The piggyback method of construction of a test function depends on ob¬ 
taining a solution to the near-equilibrium equation (3.3). Indeed, solving 
(3.3) is tantamount to solving the stability of {Xt}. It has the advantage 
that it does not actually require finding the stationary distribution 11, as 
the next result indicates, but it does require constructing the function ly. 

Corollary 3.4. Assume Assumptions A.1-A.6. If there exists a bounded 
function : 0 ^ M such that 

(3.5) supiii(i^(0{) — v{6) -Llogui(0,ei)|0o = ^) < 0, 

6»e0 

then {Xt} is V-uniformly ergodic. 

Theorem 3.2 does not guarantee the existence of any particular moments 
of the stationary distribution for {Xt}. Two equivalent conditions which do 
are provided next. 


10 


D. B. H. CLINE AND H. H. PU 


Theorem 3.5. Assume Assumptions A.1-A.6 and suppose E[\ei\^) < 
oo, r > 0. The following are equivalent conditions for {At} to be V-uniformly 
ergodic with A'HxH’' <V{x)<L + M||3:||’' for some positive K and finite 
L,M, and for {Xt} to have a stationary distribution with finite rth mo¬ 
ment: 


that 

(3.6) 


(i) There exists A:0^ ( 0 , 00 ), bounded and bounded away from 0, such 

m), 


supE 

0G0 


m 


■{w{9,ei)) 


6*0 = 9] <1. 


(ii) limsup„^^sup0ge(^(nr=i('»^(6't-i,et))'’|6'o = < 1- 


We observe that the above conditions are not equivalent to the condition 
that E{{w{9Q,ei)Y) < 1 under the stationary distribution for {^t }• Though 
more appealing, and sufficient for verifying ergodicity, the latter is neither 
necessary nor sufficient for the rth moment to exist. (See the examples be¬ 
low.) 

For nonthreshold ARCH and GARCH models, the stationary distribu¬ 
tion has been shown to have regularly varying tails [e.g., Borkovec (2000), 
Borkovec and Kliippelberg (2001) and Basrak, Davis and Mikosch (2002)]. 
(See Example 4.2.) The index of regular variation is the supremum of r sat¬ 
isfying the conditions in Theorem 3.5. Whether this is also true for more 
general models is as yet an open question. 

In general, it seems that only numerical methods will verify the conditions 
for stability and moments. We recommend simulating {9^} and estimating 
the Lyapounov exponent logp in (3.2). There is a distinct advantage, fur¬ 
thermore, to having expressed stability of {Xt} in terms of {9*} because 
the latter is uniformly ergodic. This means both that convergence of a sim¬ 
ulation will tend to be faster and that estimators are well behaved with 
relatively small variances. The only two alternatives are to conduct the very 
high-dimensional optimization required to find a test function V(x) or to 
simulate the time series itself, and pay attention only to its (highly volatile) 
behavior when it grows large. 


4. Examples. In this section we provide four examples, giving more specifics 
about their stability conditions. First, the case p = 1 is examined explicitly 
and conditions given in simple terms. Second, the known criterion for ARCH 
models is related to the piggyback method, showing how best to estimate 
the Lyapounov exponent. Third, a special TARCH(2) model can be related 
to an ARCH(2) model and, finally, second moment conditions for general 
TARCH(p) models are considered. 
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Example 4.1 [The TAR-ARCH(l) model]. Assume p=l and Assump¬ 
tions A.l and A.2. Let 

Xt = a*{Xt-i) + h*{Xt-i)et + ao{Xt-i) + 

with a*{x) = {ailx<o + a 2 tx>o)x and h*{x) = {bilx<o + b 2 tx>o)\x\, 61,62 > 0 . 
Also, ao(') and 6 o(') are locally bounded; aQ{x) = o(||x||) and 6 o(x) =o(||x||) 
as llxll —> 00 ; and b*{x) -|- 6 o(x) 7 ^ 0 for all a; G M. Then Assumptions A.1-A.6 
are all satisfied. 

Though expressed differently, this includes the usual formulation for a 
first-order AR-ARCH model with ai = 02 and 61 = 62 [e.g., in Borkovec and 
Kliippelberg (2001)]. 

Let Pi = P{ei = 1|0(] = -1) = P(ai - 6 iei < 0) and p 2 = P{ei = -1\9^ = 
1) = P{a 2 + 6261 < 0). Then LI is found to be the stationary distribution 
of a two-state Markov chain, given by n(— 1) =P 2 l{pi + P 2 ) and 11(1) = 
Pi/{Pi +P 2 )- By Theorem 3.2, {Xi} is geometrically ergodic if 

_ P 2 - 5 '(log|ai - 6 iei|) -LpiE(log [ 02 -L 6261 !) ^ ^ 

P 1 +P 2 

The proof of stability is based on an equilibrium equation (see Lemma 5.6), 
E{j2{9i) -i'{d) + logw{e,ei)\6Q = 9) =logp, 6 » = ± 1 , 
which is easily solved here: 

E(log|a 2 -^ 6261 !) - E(log|ai - 6 iei|) 

2{PI+P2) 

The function A in (3.6) has a similar, if more cumbersome, solution. To 
verify that condition, we must find 7 [= A(l)/A(—1)] such that 

7-^(1®! — 6iei|^la^_b^ei<o) + P{\ai — 6iei|^lai-feiei>o) < 1 

and 

7“^E(|a2 -I- 62 eifla 2 -|-fe 2 ei<o) + E{\a2 + 62 ei|^la 2 + 62 ei>o) < 1- 

Letting Ei^j = E{\ai + (—l)* 6 iei B^e existence of such 

a 7 equates to 

(4.1) max(Ei^ 2 ) £' 2 , 2 ) < 1 and ii'i^iE 27 < (1 — Ei^ 2 )(l ~ £' 2 , 2 )- 
On the other hand, the condition ^((^(^o,ei))^) < 1 under stationarity is 

P 2 {Ei,i + -£' 1 , 2 ) +Pi{E 2 ,i + £^ 2 , 2 ) ^ ^ 

P 1 +P 2 

which certainly neither implies nor is implied by (4.1). Two cases where 
they do agree are for the ARCH(l) models (ai = 02 = 0, 61 = 62 ) and for the 
TARCH(l) models (oi = 02 = 0) with errors symmetric about 0. 
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Example 4.2 [The ARCH(p) model]. Here, the model is 
6 = (&o + + • • • + 

Assume Assumptions A.l and A .2 and each bi > 0 . A standard way to 
handle this is to embed it in a random coefficients model [Bougerol and 
Picard (1992b) and Basrak, Davis and Mikosch (2002)]. To do this, let 
-p+i) so that Yt = Ct + BtYt-i for an i.i.d. sequence of random 
matrices and vectors {{Bt,Ct)}. Indeed, 


Bt = 

(hlel blel 

1 0 

0 

and Ct = 

( blet \ 
0 


t 0 

1 0 j 


1 0 ; 


Define Mt = Bf ■ ■ Bi, Mq = I and A^ = log(jjMtj]/jjMt_i jj), where any ma¬ 
trix norm may be chosen. There exists, irrespective of the norm, 7 '^^ limt_>oo 7 -®(log(llMt ]])) 
and hence 

1 * 1 

(4.2) lim -^Ai = lim -log(llMtll) =7 a.s. 

t—>oo t t^oo t 


[Furstenberg and Kesten (1960) and Kingman (1973)]. Under the given as¬ 
sumptions, the necessary and sufficient condition for { 17 } to have a station¬ 
ary solution is 7 < 0 [Brandt (1986), Bougerol and Picard (1992a), Theo¬ 
rem 2.5, and Goldie and Mailer (2000)]. 

Moreover, suppose { 6 *} is the collapsed process for {X^} and define T/' = 
{{ 6 * 1 )'^,..., {Ot^pYy■ Let 1= (1,..., 1)'. Then it is easy to show that 


n 


MtT^ 

YMtT* 


for all t and {w{&t-iXt))‘^ 


I'Mt-iT*- 


Therefore, with Tq = |l and p as defined in Theorem 3.1, 


1 * 

21 ogp= lim -^ 21 og(u;( 6 '*_i,ei)) 

= lim ylogd'MtTo) = lim y logdlMt]]) = 7 . 

t^OO t t-t-OC t 

This gives an alternative method for estimating the Lyapounov exponent. 
While earlier authors have recommended simulating the matrices Bt, com¬ 
puting a norm of their product and applying (4.2) in order to estimate 7 , 
we recommend simulation of 9* (or T^) instead. 

The stationary distribution for related GARCH models is known to have 
regularly varying tails [Basrak, Davis and Mikosch (2002)]. Their argument 
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applies here for an ARCH(p) model as well, and the index of regular variation 
is the positive value of k satisfying 

(4.3) = 

t^OC 

which is based on a result of Kesten (1973). See also Goldie (1991). The 
unbounded support of the error density / (Assumption A.l) ensures that 
a solution to (4.3) does indeed exist. From our discussion above, we may 
easily see that such k as satishes (4.3) must also satisfy 


Note that the condition in Theorem 3.5(ii) essentially is that r < k. 



(wiOl 



= 1 . 


Example 4.3 [The TARCH(2) model with delay specihc conditional het- 
eroscedasticity]. Let 6 i > 0, 62 > 0 and consider the order 2 model: 


Ct = b{Xt-i)et 


(^10 + ^i(Ct-i + if Ct-i < 0 , 

(&20 + bUCLi + if Ct-i > 0 . 


Assume Assumptions A.l and A .2 and also that the errors have density 
symmetric about 0. This is a restricted form of the order 2 model with 
threshold delay 1. Other than the coefficient due to the delay criterion, 
the conditional heteroscedasticity is proportional to ||A^t||. We will show 
this model has the same stability criterion as a random coefficients model 
suggested by the piggyback method, even though the TARCH model itself 
cannot be embedded in a random coefficients model. 

Let 9 = ( 6 * 1 , 02 ) and b*{6) = 6 il 6 ii<o + 02 l 6 ii>o- Given initial state 9q = 
(^o,D^o, 2 )> we have 


9 


* _ 

1 — 


//I* /)* 


(6*(0o*)ei,0o*.i) 

{b*{9lY\ei\^ + \9l^^Y/‘^' 


Since the error distribution is symmetric, |ei|, sgn(ei) and 0 q are indepen¬ 
dent. Since 6*(0o) depends only on sgn(0Q]^) =sgn( 0 | 2 )! it is easy to see 
then that sgn(0^]^) and (|0| i|,sgn( 0 J' 2 )) are independent. Thus, under the 
stationary distribution, sgn( 0 Q j^) and | 0 q are independent and hence | 0 q 
and 6 *( 0 g)|ei| are independent. 

Now consider an ARCH(2) process with uniform heteroscedasticity and 
error density given by J{u) = i^f{u/bi) + ^f{u/b 2 ). That is, let {et} be an 

i.i.d. sequence from / and = (1 + ?|_i +Ct_ 2 )^^^ 6 T This is, in fact, a special 
case of the model of this example, but with both coefficients equal to 1 and 
with a different error distribution now depending on 61 and 62 - Applying the 
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comments above accordingly, it is apparent that the stationary distribution 
of \0*i\ (but not of 6^) is nevertheless the same for both. 

By the comment following Theorem 3.1, the condition for geometric er- 
godicity of {^t} may be expressed as ili(log(|6*(0o)ei|/|0o,il)) < 0 under the 
stationary distribution, or equivalently as £'(log(|ei|) — i?(log(|0o,iD) < 0. 
This depends only on the stationary distribution of \0l]\. Therefore, 
and {^t} have identical stability criteria. The previous example discusses 
ARCH models in more detail and relates them to a random coefficients 
model. 

The second moment condition for the random coefficients model associ¬ 
ated here is + b 2 )E{el) = £^(2ef) < 1, and this coincides with (4.4) found 
in Example 4.4 for a more general TARCH model. 

Example 4.4 [The TARCH(p) model with delay 1]. Assume Assump¬ 
tions A.l and A. 2. Consider = b{Xt-i)et, where 

5 ( 3 .) _ I ^^10 ^ + • • • + if xi < 0 , 

1 (^20 +^ 21^1 H- ifxi>0, 

and bji > 0, i = 1,... ,p, j = 1,2. To get an explicit rth moment condition for 
this model, when r <2, definepj = P((—l)-^ei > 0) and Ej = £'(|ei|^l(_i)jei>o 
j = 1,2. Then 

(4.4) b[,E^ + b^2iE2 + E(6 I.Pi + bl,p,)E{\e, D < 1 

i=2 

implies (3.6) is satished if r < 2. This is proven at the end of Section 5. With 
symmetric errors, this reduces to 

kmi + • • • + Kp) + {bl, + • • • + bl2,))E{\e, D < 1. 

(Compare this to the condition given in Corollary 2.2.) In fact, when r = 2 
the test function is optimal, with the expectation in (3.6) having the same 
value for all 6, suggesting this is the best possible condition for ergodicity 
with finite second moment. On the other hand, the condition E{{w{6Q,ei)'^) < 
1 under stationarity is 

^((^ 11^1 “I-1" blpOp)l0^<o 

+ (^ 21^1 + • • • + b2p0p)^ei>o + 1 — 0p)^id9)E{\ei p) < 1. 
Simulations indicate that this is not the same as (4.4) with r = 2. 
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5. Proofs. The proof for the case p = l follows the same piggyback prin¬ 
ciple as does the proof for the case p > 1 but it is much simpler, since 
0 = {—1,1} is finite, and we therefore omit it. 

We start by asserting some regularity on {Xt} and proving the simple 
conditions in Theorem 2.1 and Corollary 2.2. 

Lemma 5.1. Assume Assumption A.l. {Xt} is an aperiodic, pp-irreducible 
T-chain on M^. 

Proof. The lemma follows from Assumption A.l by Theorem 2.2(ii) of 
Cline and Pu (1998). □ 

Proof of Theorem 2.1. We use essentially the same argument as Lu 
and Jiang (2001). Let (5 e (0,1) satisfy = 1 and define 

p 

di = ^(5''~^~^Cj, i = l,...,p, (ip+i = 0, 
j=i 

so that (5di = Ci-\- dj+i and di = 1. Let V{x) = l-\- di\xiY. By (2.2), 

p-i 

E{V{Xi)\Xo = x) = l + Ei\Ci\^\Xo = x) + J2 di+i\xi\" 

1 = 1 

p p-i 

di+i |xj|^ = l — /3-|-iL-|- (3V (x). 

i=l i=l 

By a standard result [cf. Meyn and Tweedie (1993), Theorem 16.0.1] and 
Lemma 5.1, {Xt} is P-uniformly ergodic and the stationary distribution has 
finite rth moment. □ 

Proof of Corollary 2.2. Note first that, if r < 2, then 

(5.1) V{x) < (6o + b\x\ H-h 6pXp)^/^ <hQ + h\\xi\^ ^ -h . 

Also, if r < 1, then 

(5.2) |a(x)r < aS + a^jxir + • • • + a},\xp\\ 

However, if 1 < r < 2, then by Jensen’s inequality, 

(5.3) (aijxij -I-h apjxpl)'’ < (aijxij'' H-h ap|xp|^)(ai H-h apY~^. 

Also, for any small J > 0 there exists M < oo such that |a(a:)|^ <M-|-(1-|- 
d){T]i=iat\x,\r. 

(i) Since r < 1, it is immediate that Ll(|^i|^ | Xq = x) < \a{x)\'^ 6'’(x) x 

LJ(|ei|^), and thus (2.2) follows from (5.1) and (5.2). 
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(ii) For 1 < r < 2 the conditions on the errors imply 

-Ed^ri^o = x) = ^E{\a{x) + 6(x)eid) + ^E{\a{x) - b{x)ei\'') 
<\a{x)\^ + b^{x)E{\ein, 

using the fact that (1 — uY + (1 + uY — 2vJ' < 2 for 0 < u < 1. We now apply 
(5.1) and (5.3) with Cj = (l + 5)ai(Z)fc=i®A:)^~^ Eb\E{\eiY) and 6 sufficiently 
small. □ 

Next, we have two lemmas about {6^} followed by the proof of Theo¬ 
rem 3.1. 

Lemma 5.2. Assume Assumptions A.l, A.4 and A.5. Then the following 
hold: 

(i) {A*} is an aperiodie, Hp-irreducible T-chain when restricted to RJ = 

(ii) {0|} is an aperiodic, fiQ-irreducible T-chain when restricted to 0^ = 

e\Ho. 

Proof, (i) By Assumption A.5, b* is locally bounded away from 0 on 
so the n-step transition density gY{-',x) is well defined on for any 
n > p and any initial state x in K'. Furthermore, it is locally bounded 
away from 0 and full. Hence is absorbing and is aperiodic and 

^p-irreducible on M-. 

For any 2 : G K#. let Gz be an open set containing z such that its closure 
is compact and contained in K#' Then 

Tz{x,A)'^=tGYx) [ inf gf{y;u)dy 
Jau&Gz ^ 

defines a kernel on nontrivial at z, such that Tz{-,A) is lower semicon- 
tinuous for each A and Tz{x,A) < PP{x,A). By Meyn and Tweedie [(1993), 
Proposition 6.2.4], {Xf} is a T-chain when restricted to 

(ii) For any set A C 0 we define the cone Ca = {x G Mq : x/||x|| G A}. Since 

P{9*t G A\9*o = 6)= P{Xf G Ca\X* = cO) 
for any A, t, c and 9, the result follows easily from (i). □ 

Lemma 5.3. Assume Assumptions A.1-A.5. Given ei G (0,1), there ex¬ 
ists compact Gi C 0:^ such that the following hold: 

(i) P{ei G = 0) > 1 - ei for all 0 G Ci; 

(ii) P(0p G Cij^Q = 9) > 1 — pei for all 9 
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Proof. Let Lq = sup„(l -|- \u\)f{u), which is finite by Assumption A.2. 
Suppose a and /3 are values with (5 >0 and max(|a|,/3) > 0, and suppose s G 
(0,max(|a|,/3)/2). This implies f5 + max(|Q!| — e,0) > max(|a|,/3)/2. Then, if 
/3>0, 


(5.4) 


P{\a + f3et\ < e) < To J 


{-a+e)/(3 I 


< 


{—a—e)/f} 1 + ju 

2Loe 


■ du 


< 


'^Lq£ 


/3-|-max(|a| — e, 0 ) max(|a|,/3) 


The above holds trivially in case /? = 0 since, in that case, \a + I3et \ = |a| > e. 

Now let Li = infeg© max(|a*(0)|, 6*(0)) and L 2 = sup^g© max(|a*(0)|, 6*(0)). 
Note Li > 0 by Assumption A.5 and L 2 < 00 by Assumption A.3. By (5.4), 
we determine that if e G ( 0 ,Li/ 2 ), then 


(5.5) P(|z(0,et)|<e)<4Loe/Li. 

With no loss we suppose £i G (0, Li/2). Let £2 = Choose Mi > 1 

so that P {\et\ > Mi) < £2 and thus, applying (5.5) with e = £ 2 , 

(5.6) P{\z{e,et)\ > £ 2 ; \et\ < Mi) > 1 - £ 1 . 


Fix 7 = 1 -|- L 2(1 + Ml) and define = (z(x, u),xi ,..., Xp-i). Then 

(5.7) |u| < Ml \z{9,u)\<j — l and \\XI^q^J\\<\z{6,u)\ + 1<'~^. 

By (5.6) and (5.7), 


(5.8) 


P(|^(0,ei)|>£2;||XiVJI<7) 

> P(|z( 6 »,ei)| > £ 2 ; |ei| < Ml) > 1 - £ 1 . 


Now dehne Ci = {6 = {61,... ,6p)-. \6i\ > £27 *,i = 1 ,... ,p}, which is com¬ 
pact. If^GCi, |^(6',ei)| > £2 and ||gj| < 7, then 1^(0, ei)|/||A^0 gj| > 
£ 27 “^ and l^il/H || > £27"*“^ for z = 1 ,... ,p- 1 . Since 61 = A*^^^ J|| A*^^^ 

when 9 q = 6, therefore, we conclude 


P{91 ^Ci\9l = 9)>P{\z{9,ei)\>£2-, || || < 7 ) 

> 1 — £1 for 0 G Cl. 


Thus (i) is proved. By (5.8) and an induction argument, (ii) follows as well. 

□ 


Proof of Theorem 3.1. By Lemma 5.2(ii), {91} restricted to 0^ 
is an aperiodic, /X 0 -irreducible T-chain. For any £1 G (0,1), let Ci be as 
in Lemma 5.3. Then Ci, being compact, is small for the restricted pro¬ 
cess. It follows easily that Ci is small for the process on 0 and therefore 
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Lemma 5.3(ii) implies 0 is itself small [Meyn and Tweedie (1993), Proposi¬ 
tion 5.5.4(i)]. It also follows from the lemmas that the unrestricted process 
is ^©-irreducible and aperiodic. Thus, the chain is uniformly ergodic on 0 
by Meyn and Tweedie [(1993), Theorem 16.2.2] is a T-chain and has some 
stationary distribution IT. 

The inequality (3.1) clearly holds for s € [0,ro] by Assumption A.2 and 
the boundedness of a* and b* on 0. By (5.5), there exists K < oo such that 

[ [ ^\z{e,u)\<efiu)duU{de) <Ke 

for any e > 0. Thus, (3.1) holds for s G (—1,0). We note further that \z{ 6 ,ei) \ < 
w{ 6 ,ei) < \z{ 6 ,ei)\ + \. Hence Assumption A .2 and (5.5) imply {| log(ui(0, ei))|} 6 ige 
is uniformly integrable. Thus log(r(;(0Q,ei)) has finite mean under H and p 
is well dehned. 

The near-equilibrium equation (3.3) holds by Lemma 5.6 below. □ 

We now provide several lemmas needed to construct a proof of Theo¬ 
rem 3.2. Recall that by Assumption A. 6 , a* and h* are continuous off a col¬ 
lection of hyperplanes. Hi ,..., Hm-, each of which contains the origin. Define 
F by F 6 = { 62 , ■ ■ ■ ,9p,di) and 0## = {9 € 0^ : F'^d ^ Hj for all j, k}. Note 
that excludes not only the thresholds but also certain critical points 

for which the probability of being near the thresholds in the hrst p steps 
cannot be controlled. 

Lemma 5.4. Assume Assumptions A.1-A.6. Given any 63 G (0,1), there 
exists compact Di C 0## such that 

P{91 £ Di\9^ = 9) > 1 - 63 forall9£Di. 

Proof. There exist hi,..., hm G Mg such that 9 G 0## if and only if 
h'jF^9 7 ^ 0 for all j, k. Since F^ = I, it suffices to assume the hrst coordinate 
of each hj is 1 . 

Set El = E 3/2 and dehne 7 , Ci and g as in the proof of Lemma 5.3. 

Then, by that proof, 

(5.9) P{91 G Cl, II II < 7|0o* = 9)>l- £ 3/2 for all 9 G Ci. 

Also let Lq be as in the proof of Lemma 5.3, L 3 = inf^gc^ 6*(0), L 4 = 
mm{\hj^k\ ■ hj^k 7^ 0} and £4 = • Dehne 

Di = {9 £ Cl: \h'jF^9\ > £ 47 ”^ for all j = 1,..., m, fc = 0,... ,p — 1}. 

Dehne hj^p+i = hj^i = 1. If 9 q = 9 and || A* ^ gj| < 7 , then 

Ih'F^eJI = \h,,p+i.k{z{9,ei)-9p) + h'^F'^-^9\/\\Xlg^,J\ 

> \hj^p+i_kiz{9, ei) - 9p) + h'jF’^~^9\/j. 


(5.10) 
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Thus 9 ^ Di and hj^pj^i-k = 0 imply 

Also, note that, if 0 G Ci, then 


(5.11) \h!jF^ei\>%F^-^e\h>£^-f 


-k 


2Ln 


(5.12) P[\z{d,ei) — u\<c) = P{\a*{9) — b*{9)ei — u| < c) < —r—c, 

As 

for all M G M and c > 0. Let 


Uj,k,9 — 


h'.F^-^9 

^T) 1 if 7^ 0? 




0 , 


if h 


'j,p-\-l—k 


-k = 0. 


Therefore, using (5.9)-(5.12), 

P{91 e Di\d*o = 9) 

> P{91 G Ci; ||X*0,eill < 7; \h'jF^0l\ > for all j,k\9* = 9) 

> 1 - y - P\^z{9,ei) - Uj^k,e\ < y— for some j, fej 

63 2mpLoe47 , 


□ 


Lemma 5.5. Assume Assumptions A.1-A.6. Suppose q{9) is bounded on 
0 and continuous on &##■ Then E{q{9^)\9Q = 9) is continuous on &## for 
each t>l. 


Proof. Fix t > 1, e G (0,1) and compact C C &##■ Define L 5 = sup 0 g 0 \q{9)\ 
Pick £3 G (0, Lemma 5.4 and its proof, which in turn depends on 

the proof of Lemma 5.3, there exists Mi so large that P(|ei| > Mi) < £ 3/2 
and compact Di with C C Di C ©## such that 

(5.13) P{9leDi\9^ = 9)>l-£3 forall0GDi. 

Again let Xl,,^^ = {z{x,u),xi,...,Xp-i) and define = 

Since q is uniformly continuous on Di, choose 5o > 0 such that 

(5.14) \\9'-9"\\<5o, 9'eDi,9''eDi \q(e>) - q{9'')\< e^. 

Also, {9\qiu'-\'^\ ^ ^ 1 } is uniformly equicontinuous on Di, so choose Sk, 
k>l, such that if |n| < Mi, 
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Now let {01 0 t} and {01 q,,} be the processes that start with 0' and 0", 
respectively. We thus have, by (5.13) and (5.15), 

Pi\\0k,9’ ~ Okfi" II < ^t-k\0^ 0/ G Di]Ol 0n G Di) 

> Pi\\0k-i,e' ~ ^fc-i,6»"ll < ^t-k+i, 

0k-l,9' ^ ^ l^fcl ^ -^l) “ ^3 

> -P(ll^fc-I, 6 i' “ ^fc-i, 6 »"ll < ^t-k+i',Ol_i 0 , G Di-,OI_ 10 „ G Di) — 2^3, 
for A: = 1,... ,t. Hence, if O' G Di, 0" G Di and ||0' — 0"\\ < 6 t, then 

^(ll^tV - ^tVII < ^o-,Ol0, G Di;Ol0„ G Hi) > 1 - 2te3. 

Applying (5.14), 

(5.16) P{\q{Ol0,) - q{Ol0„)\ < 63 ) > 1 - 2 ^ 3 . 

From (5.16) we obtain, if 0' G Hi, 0" G Hi and \\0' — 0"\\ < 5t, then 
\E{qm0l = O') - E{q{0l)\0l = 0")\< H(|g(0,» - g(0,»|) 

< £3 + 2L^P{\q{Ol0,) — q{O*0ii)\ > £ 3 ) 

< (1 + 4tL5)£3 < £. 

The conclusion then follows since C C Hi and since £ and C are arbitrary. 

□ 

This lemma identifies the implicit behavior of {0* } that we will piggyback 
upon, namely a near-equilibrium equation. 

Lemma 5.6. Assume Assumptions A.1-A.6. If p is defined as in (3.2), 
then for any £5 > 0, there exists a bounded function 1 /: 0 ^ M, such that 

(5.17) sup|H(i/( 6 »i) - i/{0) +logw{0,ei)\0Q = 0) - logp| < £ 5 . 

6 »e 0 

Moreover, u is continuous on 

Proof. Fix £5 > 0. By definition, 

(5.18) log/ 3 = / / log{w{0,u))f{u)dull{d0). 

Je Jm. 

Define q{0) = E {logw{0,ei)), which is bounded. By (5.18) and the uni¬ 
form ergodicity of {0^}, there exists (5 < 1 and Ki < 00 such that 

\E{q{0^)\OQ = 0) — log/?| < A'liJ* for all t > 1 and all 0 G 0 
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[cf. Meyn and Tweedie [(1993), Theorem 16.2.1]. Choose T such that KiS^ < 
65 and let 

u{9) = j2E{q{etm = 9). 

t=o 


Then 


E{u{9l) - u{9) + logw{9,eiM = 0)= E{q{9*T)K = 0) 
and (5.17) follows immediately. 

Furthermore, q is continuous on 0#^ and therefore u is also continuous 
on 0##, by Lemma 5.5. □ 

Previously we defined = {z{x,u),xi,. .. ,Xp-i) and = Xl^^^^/\\X 

Now dehne = (a(x) -L h{x)u, xi,..., Xp-i) and 9i^x,u = Xi^:,^u/\\Xi^x,u li ■ 

Additionally, let 

~9t = egx,.,,e, = Xt/\\Xti 
= and = 

In the following arguments it will be crucial to compare Xt to X* (and 9t 
to 0*), to consider how they would differ if Xt-i is acted upon by a* and b* 
instead of by a and h. 

Recall z{x, u) = a*{x) + h*{x)u. Dehne also c(x, u) = ao{x) + bo{x)u so that 
a{x) + b{x)u = z{x, u) + c(x, u). 

The next two lemmas show that 9t and 9^ are each eventually within 
a compact subset of (hence away from singular behavior), with high 

probability. 


Lemma 5.7. Assume Assumptions A.1-A.5. Given any ei G (0,1), there 
exist 7 > 1, ?7 G (0,1), M 2 < 00 and compact set C 2 C 0^ such that, if ||x|| > 
M 2 rf-~^ and if either a:/||x|| GC 2 or t>p, then 


(5.19) P{9tGC2-, 9;eC2; 7< 


IX. 




< (7 + r/)* Xo = X > (1 - ei)*. 


Proof. As in the proof of Lemma 5.3, we assume ei G (0,Lo/2). Let £ 2 , 
Ml and 7 be the same as in the proof of Lemma 5.3. We set rj = £ 2 / 2 . By 
Assumption A.4 and the dehnitions of oq and 60 that follow it, there exists 
M 2 < 00 such that 
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For t > 1 and x € x 7 ^ 0, let 


Xi-t\ 


C 2 ,x,t = \0-.\6i\>'n{-f+ ri) *,i < min(t,p); l^il >---^(7 + 7/) ,t<i<p 


Define C 2 = C' 2 ,a;,p which in fact does not depend on x. Clearly, if x/||x|| G C 2 
or t>p, then C 2 ,x,t = 02 - 

Therefore it suffices to show that, for t > 1 and ||x|| > M 2 /rf~'^■, 

(5.21) p{et G C2,xP~et G C2,x,uri^ - ^ - (7 + ^)*|^o = x) > (1 -ei)*. 

Suppose ||x|| > M 2 , |rt| < Mi and | 2 ;(x/||x||,rt)| >82 = 2??. Then, by (5.7) 
and (5.20), 

77||x|| < \z{x,u) + c{x,u)\ < 

<\z{x,u)+ c{x,u) \ + ||x|| < (7 + 7/)||x||. 

Likewise, 

2 r/||x|| < ||Xi%_„|| < 7 ||x||. 

Furthermore, for the components of 6 i^x,u and 


>(7 + ^) \ 

niin(|6»i,i,,r,n|,|6'pi,x,«l) > { |xi_i| 


I, , 


i = 1 , 

i = 2 ,...,p. 


Hence 


(5.22) 


P(er,.,u G C 2 ,xp 0 l.,u G C 2 ,x,i;v < ^ < (7 + ^) 


Xn=x 


>P |ei|<Mi; 


X 


r,ei 


>e2 > 1 - ei, 


where the last inequality follows from (5.6). That is, (5.21) holds for t = l. 
Next, assume (5.21) holds for t = k, some A; > 1. Then for ||x|| > M 2 /r]^, 

.k+i^\\Xk+i\\ 


0k+l G C'2,a;,fc+i; ^fc+1 G C2,x,k+l]'n < 


< (7 + 7) 


k-\-l 


X() = x 


7 Fl G C’ 2 ,Xi.,i;^fc+i G C' 2 ,Xfc,i; g C 2 ^x,k'i v — "TTvGrn ^ (7 + 7 ); 


and < - 77 ^ < (7 + 7 )^ 


Uc 


Xn=X 


>(l-ei)^+\ 

by conditioning on X^. Thus (5.21) holds for all t > 1 by induction. □ 
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Lemma 5.8. Assume Assumptions A. 1 -A. 6 . Given any 63 G (0,1), there 
exist 7 > 1, 7 G (0,1), M2 < 00 and compact set D2 C ©## such that, if 
||x|| > and if either x/||x|| G D2 or t> 2 p, then 


P[eteD2-,9teD2-,v^< 


'’^<(7 + r?)'Xo = x) >(l-e3)‘ 


Proof. The argument for this is analogous to that of Lemma 5.7: an 
induction by conditioning, starting with t = p and (5.19) and iterating to 
t > 2p. Using the same notation as in Lemmas 5.4 and 5.7, the induction step 
is possible by showing that if ||x|| > M 2 ? 7 “^ Oq = t/||x|| G C 2 and h'^F^OQ > 
£4(7 + 7)“^ for /c < t, t = 0,... ,p — 1, then 

P(h;.F'^0i>£4(7 + 7)"^ 

h'jF^ei > £ 4 ( 7 -L 7 )“^, 1 < j < m,0 < A: < t; Ai) > 1 -£ 3 /^, 

where 

Ai = {h G C2-,~ei G 6-2; 7 ||t|| < llXill < (7 + 7 )l|x||}. 

In other words, if 6 t and 6 ^ are both in C2, then we can reach D2 with both 
in p steps, with high probability. The argument for this is the same that 
yielded (5.21) and (5.22). □ 


Lemma 5 . 9 . Assume Assumptions A. 1 -A. 5 . Then 

sup ) ) < 00 for all s e {-l,ro], 

xgrp VV 1 + ||t|| / J 

and ||x|| —> 00 implies || —> 00 in probability. 


Proof. Let K2 = sup,e„p _ clearly, < 1 + 7^2(1 + 

|ei|), which establishes the result for 0 < s < tq. (Assumptions A .4 and A .5 
are not needed for this.) 

Next, let Li = inf^gemax(|a*( 0 )|,6*(6*)), as in the proof of Lemma 5 . 3 . 
Choose M3 > 1 such that 


max 


|qo(3;)I ^ ^ 

1 + ||x|| ’ 1 + ||x|| / “ 4 


whenever ||a:|| > M3, 


by the definitions of oo(x) and bo{x) following Assumption A. 4 . Define 
Lq = inf||3,||<;^^3 T+H’ which is positive by Assumption A.l. Thus, ||x|| < M3 
implies 


( Hx)\ b{x) \ 
\i + ||x|| ’ 1 + ||x||y 


max 


> Lq. 
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On the other hand, ||a:|| > M 3 implies 
|a(x)| b{x) 


max 


1 + ||a;|| ’ 1 + ||a;| 


> max 


/ |a*(x)| - |ao(x)| b*{x) - |6o(x)| 
1 + ||x|| ’ 1 + ||x|| 




^ max(|a*(a :)|, ^ 
2\\x\\ 4 “ 4 ' 


Applying (5.4), then, for all e G (0, min(Li/ 8 , ^6/2)) and x G 


P 




,x,ei I 


1 + UC 


<s]<P 


a(x) b(x) 

+ . . II 1, 61 


1 + X 1 + X 


<e < 


4Loe 


min(Li/4,L6)' 


This ensures the expectation in the lemma statement is uniformly bounded 
for each s £ (—1,0). Furthermore, it also requires that ||Aii^a;^ei|| —> 00 in 
probability, as ||x|| —>■ 00 . □ 

Lemma 5.10. Assume Assumptions A.1-A.3. Suppose there exist a bounded 
function ^{x), pi <1 and n> 0 such that 


limsupFlf u{Xn+i) - i^{Xn) + log 
llirll^oo \ 


1 + 


n+11 


1 + \\Xr, 


Then, for some s G (0, tq] and some function A: 
bounded away from 0 , 

'A(Xi)||Ai|| 


Aq = xj < log Pi < 0 . 

—> ( 0 , 00 ), bounded and 


(5.23) 


lim sup E 


A(x)||x| 


Ao = x < Pi < 1. 


Consequently, {At} is V-uniformly ergodic with 'F(x) = 1 + A(x)||x||^ and 
( 2 . 1 ) holding. 


Proof. The proof of (5.23) is contained in the proof of Lemma 4.1(i) 
of Cline and Pu (1999), with Lemma 5.9 in support. Along with the conclu¬ 
sion of Lemma 5.1 and the fact £'(A(Ai)||Ai||^|Ao = x) is locally bounded, 
this establishes the standard Foster-Lyapounov drift condition for geomet¬ 
ric ergodicity [Meyn and Tweedie (1993), Theorem 15.0.1 and Section 15.2]. 
□ 


Proof of Theorem 3.2. We do not assume p < 1 until the very end of 
the proof. Choose Sq > 0 and let 65 = Eq/A. Define u according to Lemma 5.6. 
Extend to by defining i/(0) = 0 and i^(x) = z^(x/||x||) for x 7 ^ 0. Let 
Fi(x) = 1-1- ||x||. Then 

limsup|E(i/(A{ j^ gJ - zy(p) + log(Pi(Ai*^J/Ei(y))) -logpl 
llyll^oo 


(5.24) 


< £5 = £6/4. 
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Let Lj = sup 2 .g]gp By Lemma 5.9, there exists < oo such that 

sup £;(|log(Fi(Xi,,,ei)/Bi(y))|) < K^. 
yeKP 

Let Lg = 4max(2p| logpl, 2(2p -|- 1 )^ 7 , 2p{2Lj + K 4 )) and choose 63 < eg/Lg. 
Choose D 2 , 1 ] and M 2 according to Lemma 5.8 and define 

At = {Ot € D 2 -,et G D 2 -, ||Xili > r?'||Xo||}, t = 1 ,..., 2p + 1. 

Then, in particular. 


(5.25) P{At |Xo = x) > 1 - tea, 

if ||x|| > and either t>2pov x/||x|| G D 2 . Conditioning on (^ 2 p-i) e 2 p) 

and applying (5.24) and (5.25), we have 


limsup|£’((z^(X 2 p+i) - v{X2p) 

||ai||^oo 

+ log(yi(X2Vl)M(^2p)))lA,JXo = X) - logpl 
< eg/d + 2p| logples < eg/2. 


Since oo(x) = o(||x||), 6o(x) = o(||x||) and D 2 C 0#, we conclude 


hm mf 

y/\\y\\eD 2 



II!/IH°o y 0 eD 2 

y/\\y\\eD 2 

> 0 with probability 1 


and, given Xq = y, 

lim II 01 - 0*11 = lim ||0i,p,ei - Oly^ei 11=0 almost surely. 

y/\\y\\e 02 y/\\y\\e 02 

By the uniform continuity of i' on D 2 , therefore, 

\imsupE{\i^{X2p+i) - v{Xlpj^^)\tA2p\XQ = x) 

||x||^oo 

(5.27) <limsupL;(|i/(X2p+i)-i/(X^p+i)|llA2pA2p+i +‘^Lj1ai^^^\Xo = x) 

||x||^C50 

< lim .E(|i/(0i)-zy(0i)|lAi|Xo = y) + 2L7(2p-Ll)e3<e6/4. 

IIj/II^oo 

v/\\y \\&02 


We may also conclude 


hmsup i?(log(yi(Xi,p,eJ/Bi(Xi/^,,J)) = 0, 

y!\\v\\^D 2 
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SO that 

(5.28) 


limsup£;(log(Vi(X2p+i)/yL(X2p+i))lA2jXo = x) = 0. 


Hence, by (5.26)-(5.28), 

limsup|£'((z^(X2p+i) - v{X2p) 

||x||^oo 

+log(Hi(X 2 p+i)/Hi(X 2 p)))lA,jXo = x) -logpl 
< 3e6/4. 

The definitions of L^ and and (5.25) provide 
limsup|£’((z/(X 2 p+i) - iy{X 2 p) 

||x||^oo 


(5.30) 


+ log{V,{X2p+l)/V,{X2p)))lA^JXo = x)| 


< 2p{2Lj + Ki)e^ < eg/4. 

By (5.29) and (5.30), we conclude 

limsup|^;(i/(X2p+i) - v{X2p) 

(5.31) 

+ log(Hi(X2p+l)/Hl(X2p))|Xo =x) -logpl <£ 6 - 

Now, finally, we assume p < 1 and eg > 0 has been chosen so that logpi log p+ 
eg < 0. The result follows from Lemma 5.10 with n = 2p. □ 


Proof of Theorem 3.3. Let eg, i^(x), Ly and Vi{x) be as in the proof 
of Theorem 3.2. Note that eg is arbitrary but y{x) and Lj depend on it. On 
the basis of Lemma 5.9, choose 

A's = sup .E(|log(Ti(Xi)/Vi(x))||Xo = x) < oo. 
xGRp 

Also, let no > (dpATg + 2L7)/eg. 

Now let Bj = v{X 2 p+j)-v[X 2 p+j-i) + '^og{Vi{X 2 p+j)/Vi{X 2 p+j-i))- Then, 
by (5.31), 

limsup|ill(Bi|Ao = x) — logp| < eg. 

||ie||^oo 

Since by Lemma 5.9, limsup||j,||^j^ P(||Aii || < M|Aio = x) —> 0 for every M < oo, 
it is easy to see inductively that, for every j > 1, 

limsup|P(Pj+i|Xo = x) -logpl 

||a:||—»-oo 

< limsupP(|£'(Pj+i|Ai) - logp||Ao = x) 

||ic||^oo 

< limsup|£'(Pj|Ao = x) — logp| < eg. 
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Therefore, 


limsup-|£’(z^(X2p+n) - i^{X2p) 

II II 77 

||a:||—»-oo 


(5.32) 


+ log(Vl{X2p+n)/VliX2p))\Xo = x)- logpl 


= lim sup 

||fc|l^C50 


- 1^0 = t) - log p 


n 


i=i 


< £6- 


Note that 

E{\log{Vi{Xn)/V,{x)) - log{Vi{X2p+n)/Vi{X2pmXo = x) 

= E{\log{ViiX2p+n)/Vi{Xn))-log{Vi{X2p)/Viix))\\Xo = x)< 4 pK 5 . 

Consequently, by (5.32), 


lim sup - 


1 


n 


E[ log 


VljXn 

Vi{x) 


Xo = x] - logp 


^ , 4piC5 -I- 2Lj ^ ^ 

< 60-1 -- < 260, 


n 


for every n > no- Since Eq can be arbitrarily small, this proves (3.4) and 
hence the Lyapounov exponent must be logp. □ 

Proof of Corollary 3.4. Since a stationary distribution 11 exists for 
{6t}, (3.5) implies 

logp= [ [ \og{w{6,u))f{u)duIl{d9) 

Je Jm 

= [ E{i^{ei)-i^{e) + iogw{e,ei)\e*o = e)u{de)<o. 

Je 

P-uniform ergodicity follows by Theorem 3.2. □ 

Proof of Theorem 3.5. Define Q## as before and assume (i) holds. 
We first verify that {Xt} is P-uniformly ergodic. We show below that (i) 
implies (ii) and then that (ii) implies (i) with A continuous on &##, bounded 
and bounded away from 0. Therefore, there is no loss in assuming that A 
is continuous on bounded and bounded away from 0. Let Vi{x) = 

1 -|- ||x||'’. By an argument analogous to that for Theorem 3.2, one may show 
that 

E{X{X2p+i/\\X2p+i\\)Vi{X2p+i)\X^ = x) 

E{\[X2p/\\X2p\\)V^{X2p)\Xo = x) ^ • 

The drift condition for geometric ergodicity is therefore satisfied with test 
function V{x) = E{\{X 2 p/\\X 2 p\\)Vi{X 2 p)\XQ = x). From (5.5) we have 

E{\a*{x) + h*{x)ei\'') > E{\a*{x)+ h*{x)ei\''l\a*{x)+b*{x)ep>e\\x\\) 
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for some > 0, and therefore by ( 1 . 1 ) and the assumptions ,ii^((H-||Xi||'')|A'o 
x) > ( 52(1 + II^^ID for some 62 > 0. Thus, £'((1 + ||X 2 p||^)|Xo = x) > + 

Ijxll’'). Since \{9) is bounded away from 0, it follows that V{x) > iir||x||^ for 
some positive constant K. Likewise, V{x) < L + M||x||^ for finite L,M. 

Next, we show that (i) implies (ii). Let f5 be the left-hand side of (3.6) 
and choose Lg < 00 such that I/L 9 < X{9) < Lg for all 9. By (3.6) and the 
Markov property. 


E(Y[{w{9;_„et)y 


Kt=l 


= 9 


j n—l 

<L9L;(£;(A(C)(^(C-i,en))n0;-i)n(^(^t-i>ei)y 


t=l 


= 9 


n—l 


<LgPE(X{9:_,)Y[{w{9l„et)r 




t=i 


< ■ ■ ■< Lg(5^X{9) < L^/3". 


The condition in (ii) follows easily. 

Finally, we assume (ii) and verify that (i) holds. We need to construct a 
test function X{9) that is bounded, bounded away from 0 and continuous on 
0##. This has two parts. 

First, we dehne A and show it satisfies (3.6). Choose n > 1 and (5 > 0 such 
that 


(5.33) 


sup 


e&e\ 


(E(f{{5 + w{9U,et)y 


A =1 


91 = 


< 1 


and dehne Qt = ((5 + w{9*_i,et)y■ The test function we need is 


n—l 




X{9) = X{{E{Qf-Qi\9l = 9)) 

t=i 

Applying Holder’s inequality to n factors, 

E{X{9l){w{9,e,)r\9l = 9) 

/ n—l 

<£; X{{E{Qt+i---Q2\9l)Qif^'^QT 


.t=i 


< \{{E{Qt ■ • ■ Qil^o* = e)f/^ = {E{Qn ■ • ■ Qil^o* = 0))'^"A(0), 




t=l 


thus verifying (3.6) by (5.33). 
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Second, we show A has the desired properties. Define qt{d) = E{Qt ■ ■ ■ Qi\0q 
9). By the Markov property, 

(5.34) qt{e)=E{qt-i{ei)Qi\ei = e). 

Let iLg = supe £'((5 i|0q = 9) and by iteratively using (5.34) we have 5^ < 

qt{9) < Kl and < x{9) < for all 9. 

Note that A is continuous on ©## if each qt{9) is. Clearly, qi is continuous 
on ©## since w{9,ei) is and {(tc(0, ei))^}6(ee is uniformly integrable. By 
the argument of Lemma 5.5, qt-i{9) continuous on ©## implies qt{9) = 
E{qt-i{9\)Qi\9Q = 9) is also, and we obtain the conclusion inductively. □ 

Proof of Example 4.4. Define ci = + ^21 ^2 and Ci = + 

h' 2 iP 2 )E{\ei 1^), i = 2,... ,p. Choose (5 G (0,1) such that = 1. Now 

let djp = f3~'^V'jpE{\eiY), j = l,2 and 

dii = p-%E{\eiY)+ z = 1,...,p- 1, j = l,2. 

k=i+l 

Thus, diiEi -I- d 2 iE 2 = Edei]^), 

(5.35) hjpidiiEi + d2iE2) = Pdjp, j = 1,2, 
and for i = 2,... ,p — 1, j = 1,2, 

(5.36) hjiidiiEi + d2iE2) + (di,i+iPi + (i2,i+iP2)-E'(|ei |^) = j3dji. 

Now define dj^p^i = 0, j = 1,2, i?i = {x: xi < 0}, R 2 = {x : xi > 0} and 

f diilxil^-I-hdiplxpl^, if xi < 0, 

E(x) = < 

l'^2i|ici|^4- \-d2p\xp\'^, if xi > 0. 

Applying (5.35) and (5.36), 

E{V{X*)\X* = x) 

2 / p \r/2 

= E E tR,{x){dnEi + d 2 iE 2 ) 

j=l\i=l / 

2 p 

+ E E(^14+i^’i + d 2 ,i+iP 2 )\xi\''lR^ (x)E(|eir) 

j=li=2 
2 p 

< EE(^t('^ii^i +^ 21 X 2 ) + {di^i+iPi + d 2 ,i+iP 2 )E{\ei\''))\xi\''lR.{x) 

j=i i=i 

2 p 

j=i i=i 
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with equality when r = 2. 

Letting X{6) = V{9), for 0 € 0, leads immediately to (3.6) and the conclu¬ 
sion. 

□ 
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